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(54) Computing interface system 

(57) A computing interface system includes a 
mouse (16) with a keypad (40), and a computer display 
(12) that displays a group of icons that have a one-to- 
one correspondence to the keys (42) composing the 
mouse's keypad (40). The icons have the same relative 



positioning as the keys (42) composing the mouse's 
keypad (40). This arrangement permits the user to enter 
digits into the computer (10) without repeatedly shifting 
his or her gaze back and forth between the keypad (42) 
and display (12). 
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Detailed Description of the Invention 



Description 

Cross-Reference to Related Applications 

This application is related to commonly assigned 
and concurrently filed U. S. patent application 
08/339,386, filed November 14, 1994, entitled "Comput- 
ing and Telecommunications Interface System" 

Background of the Invention 

In the past when it became necessary to enter nu- 
merical information into a computer that used a mouse 
as an input device, the user had to move his or her hand 
between the mouse and a keyboard. U. S. Patent 
5,063,376, entitled "Numeric Mouse One Hand Control- 
lable Computer Peripheral Pointing Device", presented 
a partial solution to this problem by providing a mouse 
with a keypad. Unfortunately, this partial solution result- 
ed in the user repeatedly looking backand forth between 
the computer's display and the mouse. The user had to 
monitor the display to verify proper data entry into the 
computer, and the user had to repeatedly shift his or her 
gaze to the mouse in order to stay oriented with respect 
to the keys composing the mouse's keypad. 

Summary of the Invention 

An embodiment of the present invention provides a 
complete solution to the above described problem by 
displaying a keypad on a computer's monitor so that the 
keys composing the displayed keypad have a one-to- 
one correspondence to the keys composing a mouse's 
keypad. This enables the user to verify data entry into 
the computer while maintaining orientation with respect 
to the mouse's keypad, without shifting his or her gaze 
back and forth between the monitor and the mouse. 

In another embodiment of the invention, an icon 
representative of the entire mouse is displayed on the 
monitor. The icon includes active regions where the ac- 
tive regions have a one-to-one correspondence to the 
keys composing the mouse's keypad. When a key is 
pressed on the mouse's keypad, the corresponding ac- 
tive region changes appearance. 

Brief Description of the Drawings 

FIG. 1 illustrates a computer, mouse and telephone 
network; 

FIG. 2 is a top view of a multifunctional mouse; 
FIG. 3 is a side view of a multifunctional mouse; 
FIG. 4 is a block diagram of a multifunctional 
mouse; 

FIG. 5 illustrates a display screen; and 

FIG. 6 illustrates a single icon with multiple active 

regions. 



FIG. 1 illustrates computer 10 which communicates 
with display 12 and keyboard 14. Mouse 16 is used to 

s control the position of icon 1 8 that is displayed on display 
12, to enter numerical data into computer 10 and to com- 
municate using telephone network 20 through tele- 
phone network interface 22. In this embodiment, mouse 
16 communicates with computer 10 using a conductor 

10 and with telephone network interface 22 using infrared 
signals. 

FIGs. 2 and 3 are top and side views, respectively, 
of multifunctional mouse 16. The top surface of multi- 
functional mouse 16 includes keypad 40 which is com- 

15 posed of user activated switches or keys 42. The keys 
can be numbered in any particular order; however, it is 
desirable to have an arrangement of keys 42 similar to 
that of a typical telephone. 

Keys 44 and 46 are used to instruct computer 10 to 

20 change the way in which it interprets the activation of 
keys 42. Computer 1 0 interprets the activation of switch- 
es 42 in two ways depending on the way in which mouse 
16 is to be used. If mouse 16 is to be used in a keypad 
mode, switches 42 are interpreted as a keypad, that is, 

25 the activation of keys labeled "1 ", "2", u 3", etc. are inter- 
preted as the digits 1, 2, 3, etc., respectively. If mouse 
16 is to be used in a conventional point and click mode, 
switches 42 are interpreted in the same manner as a 
conventional mouse, that is, the activation of keys la- 

30 beled "1 "2" and "3" are interpreted as the left, center 
and right buttons, respectively, of a conventional mouse. 
In the point and click mode, the remaining keys of key- 
pad 40 are ignored by computer 10. When mouse 16 is 
used in the conventional mode, and keys 44 and 46 are 

35 pressed simultaneously, computer 10 changes the way 
in which it interprets keys 42 so that mouse 16 may be 
used in the keypad mode. When keys 44 and 46 are 
pressed simultaneously again, computer 10 changes 
the way in which it interprets keys 42 so that mouse 16 

40 may be used in a conventional point and click mode. It 
is also possible to switch between the keypad and con- 
ventional modes using a single key; however, using two 
keys helps to prevent accidental switching between 
modes. 

45 Switches 48 and 50 are used when a user desires 
to communicate over telephone network 20. Switches 
or keys 48 and 50 are used to switch from an off-hook 
to an on-hook condition, or from an on-hook to an off- 
hook condition. A user switches between off-hook and 

50 on-hook conditions by simultaneously pressing keys 48 
and 50. For example, to begin a telephone conversation, 
a user presses keys 48 and 50 to create an off-hook 
condition and to obtain a dial tone. When a user desires 
to end a telephone conversation, an on-hook condition 

55 is created by once again simultaneously pressing keys 
48 and 50. It is also possible to control on-hook and off- 
hook conditions using only a single key; however, using 
two keys helps to prevent accidental switching between 
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on-hook and off-hook conditions. A user's voice is trans- 
mitted to the telephone network using microphone 52. 
Microphone 52 is on the top surface of mouse 16; how- 
ever, the microphone may be placed in any location that 
permits reception of the user's voice. Speakers 54 are s 
located on the sides of mouse 16. It is also possible to 
locate one larger speaker on top surface 55 of mouse 
16. 

Mouse 16 may communicate with computer 10 and 
network 20 using wired communication links, or wireless 10 
communication links. In a wireless embodiment, infra- 
red light emitting diodes (LEDs) may be used for com- 
munication; however, it is also possible to use radio fre- 
quency communications. In a wireless infrared embod- 
iment, LED 58 is used to communicate with an infrared +s 
receiver in computer 10, and LED 60 is used to commu- 
nicate with an infrared receiver in telephone network in- 
terface 22. In order to minimize interference between 
the communication channels, LEDs 58 and 60 produce 
different wavelengths of infrared light. For example, 20 
LED 58 uses a wavelength to which the receiver in com- 
puter 10 is sensitive and the receiver in network inter- 
face 22 is insensitive, and LED 60 uses a wavelength 
to which the receiver in telephone network interface 22 
is sensitive and the receiver in computer 10 is insensi- 25 
tive. It is also possible to distinguish between the two 
communication channels (i.e., the communication chan- 
nel between the mouse and the computer, and the com- 
munication channel between the mouse and telephone 
network interface) by using coding schemes that permit 30 
using the same wavelength for communications with 
both computer 10 and telephone network interface 22. 
Using a coding scheme makes it possible to use a single 
light emitting diode for communications. It is also possi- 
ble to use a wire or conductor to communicate between 35 
mouse 16 and computer 10, and/or between mouse 16 
and telephone network interface 22. If a wire is to be 
used, it is desirable to use a wire for communications 
between mouse 16 and computer 10 while maintaining 
a wireless communication channel between- mouse 16 40 
and telephone network interface 22. 

In reference to FIG. 3, mouse 16 contains ball 64 
which is used to sense the motion of the mouse as it is 
moved across a surface. It is also possible for ball 64 to 
extend through the top surface of the mouse rather than 4$ 
the lower surface of the mouse. This will enable the 
mouse to be used as a track ball device in which the 
user rotates the ball to position an icon in a desirable 
location on display 1 2. The track ball embodiment of the 
invention offers the advantage of controlling the icon on so 
display 1 2 without moving mouse i 6 and thereby saves 
additional desktop space. 

FIG. 4 is a block diagram of multifunctional mouse 
16. Position detection circuitry 90 monitors the motion 
of ball 64 to produce signals that computer 10 uses to s$ 
control the position of an icon, such as a pointing icon, 
on display 12. Position detection circuitry is well-known 
in the art and uses, for example, rollers in contact with 



ball 64 so that the rollers rotate when ball 64 rotates as 
mouse 16 is moved along a surface. The rollers are po- 
sitioned 90 degrees apart along the circumference of 
ball 64 so that one roller can detect rotation resulting 
from moving mouse 16 in the X direction, and the other 
roller can detect rotation resulting from moving mouse 
16 in the Y direction. Each of the rollers is attached to a 
shaft that rotates a slotted disk, where the shafts are 
mounted at right angles to each other. The slotted disk 
interrupts a light beam between a light emitting diode 
and a photo transistor to create a signal indicative of ball 
64's rotation. Computer 10 uses these signals to monitor 
the X and Y movements of mouse 16 and positions an 
icon on display 1 2 in a conventional manner in response 
to the movements of mouse 1 6. In the case of a wireless 
connection between mouse 16 and computer 10, wire- 
less interface 92 converts signals from position detec- 
tion circuitry 90 into radio frequency or infrared signals 
that are received by a corresponding receiver in com- 
puter 10. These interfaces are well-known in the art and 
may be similar to, for example, a conventional infrared 
remote control interface used on a wireless mouse. 

Keypad 40, and keys 44 and 46 also communicate 
with computer 10, and when a wireless interface is used, 
they communicate via wireless interface 92. When a key 
is pressed, the identity of that key is passed to computer 
1 0 in a conventional fashion. As mentioned earlier, when 
both keys 44 and 46 are pressed nearly simultaneously, 
computer 10 changes the way in which it interprets the 
inputs from mouse 16. In reference to FIG. 5, it is also 
possible to instruct computer 10 to interpret the inputs 
from mouse 16 as keypad inputs rather than conven- 
tional mouse inputs by positioning pointing icon 97, 
which is controlled by mouse 16, into predefined loca- 
tion 98 on display 12. When the icon is positioned within 
this location on display 12, inputs from mouse 16 are 
interpreted as keypad inputs rather than simple click and 
point inputs. It is also possible to control the way in which 
computer 10 interprets inputs from mouse 16 based on 
which software application is being executed by the 
computer. 

Keypad 40 is also connected to conventional tele- 
phone circuitry 1 00. Telephone circuitry 1 00 receives in- 
puts from keypad 40 and microphone 52, and provides 
an output to speaker 54. Telephone circuitry 100 is well- 
known in the art and may be used to interface to tele- 
phone network 20, in a conventional wired manner using 
"tip" and "ring" lines. When it is desirable to have a wire- 
less connection between mouse 16 and telephone net- 
work 20, wireless interface 102 is used. Wireless inter- 
face 102 may be a conventional radio frequency inter- 
face such as those used in cordless telephones or it may 
be an infrared communication interface similar to those 
used in infrared remote control systems. If a wireless 
interface is used, the appropriate receiver is used as tel- 
ephone network interface 22. For example, interface 22 
may be similar to a conventional cordless telephone 
base station when radio frequency communications are 
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used, and interface 22 may be similar to a conventional 
infrared receiver when "infrared communications are 
used. In addition, telephone circuitry 100 receives inputs 
from switches 48 and 50 via control 104. As discussed 
earlier, if an on-hook condition exists, pressing keys 48 s 
and 50 nearly simultaneously will create an off-hook 
condition. If an off-hook condition exists, pressing keys 
48 and 50 nearly simultaneously creates an on-hook 
condition. Control 104 indicates an off-hook or an on- 
hook condition to telephone circuitry 100. Control 104 10 
may be implemented using an appropriately pro- 
grammed microprocessor, or a simple state machine 
that switches between one of two states when inputs 
from keys 48 and 50 are detected. 

When mouse 1 6 uses a conductor to communicate is 
with computer 10, electrical power can be provided to 
mouse 16 via the conductor. If mouse 16 is used in a 
wireless configuration, battery 110 is used to provide 
electrical power to the circuitry located in mouse 16. 
When mouse 16 is used with wireless communications, 20 
it is desirable to have a "nest" that is used to charge 
battery 110 when the mouse is not in use. 

In reference to FIG. 5, it is desirable to display on 
display 12 a plurality of icons representative of keypad 
40. In accordance with one of the principles of this in- 25 
vention, the icons are positioned in a manner that is rep- 
resentative of the arrangement of the keys composing 
keypad 40. This will enable the user to look at display 
12 while operating the keys of keypad 40 on mouse 16. 
The icons representing the keys change appearance 30 
when the corresponding key is pressed on mouse 1 6 to 
indicate to the user that computer 10 has received a sig- 
nal indicative of a key being pressed. This provides the 
user with visual feedback to indicate that the information 
is being received by computer 1 0 and also provides the 35 
advantage of permitting the user to use keypad 40 with- 
out looking back and forth between display 12 and 
mouse 16. It is also desirable to provide a display that 
matches the number, identity and configuration of the 
keys composing keypad 40; this also enables the user 40 
to stay oriented with respect to the position of the keys 
on mouse 1 6 without repeatedly looking back and forth 
between display 12 and mouse 16. For example, the 
icons may have a one-to-one correspondence to the 
keys composing keypad 40. 45 

FIG. 6 illustrates single icon 120 which is represent- 
ative of mouse 16. Icon 120 may be movable in a man- 
ner similar to that of a conventional pointing icon, where 
segment 122 is used as the pointing portion of the icon. 
If icon 120 is not movable, a conventional pointing icon so 
may be used in addition to icon 120 for providing inputs 
to the computer. It is desirable for icon 120 to be rela- 
tively small with respect to the display screen in order 
to minimize the display area covered by the icon. Icon 
1 20 includes several active regions that change appear- 55 
ance when the corresponding key of mouse 16 is acti- 
vated. In this embodiment,. active regions are provided 
for the keys composing keypad 40 and for keys 44, 46, 



52 and 54. It is possible to omit active regions corre- 
sponding to some or all of keys 44, 46, 52 and 54; how- 
ever, it is desirable to include an active region corre- 
sponding to each key. The additional active regions fa- 
cilitate keeping the user oriented with respect to the po- 
sition of the keys on mouse 16 without repeatedly look- 
ing back and forth between display 12 and mouse 16. 

It should be noted that it is possible to position 
speaker 50 or microphone 48 in other locations such as 
in or on computer 10. In this situation, signals between 
telephone circuitry 1 00, and the microphone and speak- 
er may be carried over the interface between mouse 16 
and computer 10. By placing the speaker and micro- 
phone in computer 10, it is possible to reduce the size 
of mouse 1 6; however, it may be more desirable to have 
the speaker and microphone in mouse 16 because of 
the mobility of mouse 16. 

It is also possible to position telephone circuitry 100 
within computer 10. In this embodiment, information 
from keyboard 40 is passed to computer 10 for use by 
telephone circuitry 100. When the speaker, microphone 
and telephone circuitry are located in computer 10, tel- 
ephone circuitry 1 00 communicates directly with the mi- 
crophone and speaker. When the speaker and/or micro- 
phone are located in mouse 16 and the telephone cir- 
cuitry is located in computer 10, telephone circuitry 100 
communicates with the speaker and/or microphone 
over the communication channel between computer 10 
and mouse 16. Placing telephone circuitry 100 in com- 
puter 1 0 offers the advantage of decreasing the number 
of communication channels to mouse 16 by eliminating 
the need for a communication channel that connects di- 
rectly between mouse 16 and interface 22. In this em- 
bodiment, telephone circuitry 100 communicates' with 
interface 22 via a communication channel between 
computer 10 and interface 22. 



Claims 

1. A computer interface system including a computer 
having display means 1 2 and computing means 1 0, 
CHARACTERIZED by: 

icon control means 1 6 for controlling position of 
a pointer icon on said display means 1 2, said 
icon control means 1 6 having a keypad 40 with 
a plurality of user activated switches 42; 
means for displaying on said display means 1 2 
the icon, and a plurality of icons representing 
said plurality of user activated switches 42, said 
plurality of icons having a positioning relative to 
each other on the display means 1 2 that is rep- 
resentative of a positioning of said plurality of 
user-activated switches 42 relative to each 
other on the icon control means 16; where 
said computing means 10 is responsive to sig- 
nals provided by said icon control means 16. 
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2. The computer interface system of claim 1, CHAR- 
ACTERIZED in that an appearance of an icon 
belonging to said plurality of icons changes when a 
corresponding one of said plurality user activated 
switches 42 is activated. s 

3. The computer interface system of claim 1, CHAR- 
ACTERIZED in that said computing means 16 inter- 
prets said plurality of user activated switches 42 in 

a first way prior to activation of a predetermined set 10 
of the switches 44, 46, where the set includes at 
least one of the switches 44, 46, and in a second 
way after activation of said set of switches 44, 46. 
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